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CROSS REFERENCE TO RELATED APPLICATIONS 
[01] This application is related to, and claims benefit of and priority from, 
Provisional Application No. 60/274,433 filed March 9, 2001, titled "Digital Phase Locked 
Loop for Regenerating the Clock of an Embedded Signal", Provisional Application No. 
60/263,792 filed January 24, 2001, titled "System and Method for Increased Data 

Capacity of a Digital Video Link", and Provisional Application No. 60/ 

(Attorney Docket No.: 41821/JEJ/B600) filed February 14, 2001, titled "Digital Visual 
Interface with Audio", the complete subject matter of which is incorporated herein by 
reference in its entirety. 

FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT 
[02] [Not Applicable] 

BACKGROUND OF THE INVENTION 
[03] One embodiment of the present invention relates to regenerating a clock of an 
embedded signal. More specifically, one embodiment of the present invention relates to 
embedding audio data in a video data stream and then regenerating the clock of the 
embedded audio data using a phase locked loop. 

[04] Generally, audio and video data are transmitted separately in systems. Typically 
digital video data has a minimum of sixty frames of video per second. Each video frame 
is composed of horizontal scan lines, where the number of horizontal scan lines in a 
frame is dependent on the resolution of the system. Each horizontal scan line includes a 



blanking period followed by a series of digital video pixels. The horizontal blanking 
period is used to send timing infornriation. 

[051 Accordingly, there is a need for system and method for using the blanking period 
of the video data to transmit audio data. There Is a further need to embed audio data in 
the video data stream blanking period and then regenerate the clock of the embedded 
audio data using a phase locked loop for example. 

[06] Further limitations and disadvantages of conventional and traditional approaches 
will become apparent to one of skill in the art, through comparison of such systems with 
the present invention as set forth in the remainder of the present application with 
reference to the drawings. 



SUMMARY OF THE INVENTION 



[07] One embodiment of the present invention provides a system for generating a first 
clock frequency for a plurality of digital data bursts compressed in time. The system 
includes a transmitter for transmitting a composite stream using the data bursts clocked 
at a second clock frequency and a receiver for receiving or acquiring said composite 
stream and generating the first clock frequency. The receiver includes a de-multiplexer 
for outputting a digital data stream at the first clock frequency; wherein said de- 
multiplexer includes a FIFO circuit and Digital Phase Locked Loop. 

[08] One embodiment of the present invention provides a system for generating an 
original clock frequency for a plurality of digital data sub-blocks, compressed in time. 
The system includes a multiplexer, a receiver and a phase locked loop. The multiplexer 
multiplexes each of the plurality of digital data sub-blocks into a plurality of data blocks 
of higher speed digital data. The receiver acquires the width in data elements of a digital 
data sub-block and the width in data elements of a data block of higher speed digital 
data. The phase locked loop for computes the width of one period of a clock pulse at the 
original clock frequency, and generating a clock pulse at the original clock frequency. 

[09] Another embodiment of the present invention comprises a method of generating 
an original clock frequency for a plurality of digital data bursts, compressed in time, 
where each of the plurality of digital data bursts has been multiplexed into one of a 
plurality of data blocks of higher speed digital data. The method acquires the width in 
data elements of a digital data burst; acquires the width in data elements of a data block 
of higher speed digital data; computes the width of one period of a clock pulse at the 
original clock frequency; and generates a clock pulse at the original clock frequency. 

[10] In another embodiment, the present invention comprises a method of generating 
an original clock frequency for a plurality of digital data sub-blocks compressed in time, 
where each of the plurality of digital data sub-blocks has been multiplexed into one of a 
plurality of data blocks of higher speed digital data. The method acquires the width In 



data elements of a digital data sub-block; acquires the width in data elements of a data 
block of higher speed digital data; computes the width of one period of a clock pulse at 
the original clock frequency; and generates a clock pulse at the original clock frequency. 

[11] Yet another embodiment of the present invention comprises a method for 
generating the original clock frequency for a burst of digital data compressed in time, 
wherein the burst of digital data has been multiplexed into a block of higher speed 
digital data. The method acquires the width in data elements of the burst of digital data; 
acquires the width in data elements of the block of higher speed digital data; computes 
the width of one period of a clock pulse at the original clock frequency; and generates a 
clock pulse at the original clock frequency. 

[12] In still another embodiment, the present invention comprises a method of 
generating the original clock frequency for a sub-block of digital data compressed in 
time, which has been multiplexed into a block of higher speed digital data. The method 
acquires the width in data elements of the sub-block of digital data; acquires the width in 
data elements of the block of higher speed digital data; computes the width of one 
period of a clock pulse at the original clock frequency; and generates a clock pulse at 
the original clock frequency. 

[13] Other aspects, advantages and novel features of the present invention, as well 
as details of an illustrated embodiment thereof, will be more fully understood from the 
following description and drawing, wherein like numerals refer to like parts. 



BRIEF DESCRIPTION OF SEVERAL VIEWS OF THE DRAWINGS 
[14] Fig. 1 illustrates a flow chart for regenerating a clock of an embedded signal 
transmitting audio data inserted into unused portions of a video steam; 

[15] Fig. 2 illustrates a block diagram of a DVI system adapted to send data over a 
high speed serial ("DVI") link in accordance with one embodiment of the present 
invention; 

[16] Fig. 3 illustrates a timing diagram of a horizontal scan line of a composite stream 
of audio and video data transmitted over a DVI link in accordance with one embodiment 
of the present invention; 

[17] Fig. 4 illustrates a timing diagram of a burst of audio data extracted from a 
horizontal scan line similar to that Illustrated in Fig. 3 in accordance with one 
embodiment of the present invention; 

[18] Fig. 5 illustrates a block diagram of a FIFO circuit and Phase Locked Loop used 
to output the audio data stream at the original audio clock frequency in accordance with 
one embodiment of the present invention; 

[19] Fig. 6 illustrates a block diagram of the subsystems within the Phase Locked 
Loop illustrated in Fig. 5; 

[20] Figs. 7A and 7B illustrate flow charts of the operations performed by a second 
order feedback loop of the phase locked loop of Fig. 6 in accordance with one 
embodiment of the present invention; 

[21] Fig. 8 illustrates a flow chart of the operations performed by a half period 
calculator of a digital phase locked loop in accordance with one embodiment of the 
present invention; and 
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[22] Fig. 9 illustrates a timing diagram of one example of a possible timing 
relationship between a data link clock C1 and a regenerated clock F1 in accordance 
with one embodiment of the present invention. 



DETAILED DESCRIPTION OF THE INVENTION 
[23] One embodiment of the present invention comprises a system and metliod for 
combining audio and video data into a composite stream. Ordinarily audio data occurs 
or is transmitted at a constant, continuous clock rate (i.e., an original or first clock rate) 
while video data Is transmitted at a rate different from the first clock rate. Additionally, 
video data (alternatively referred to as video signals or video stream) includes a number 
of unused portions (i.e., blanking periods). 

[24] In one embodiment of the present invention, the audio data is split Into smaller 
portions and inserted into lines of the video data, forming a composite stream that is 
transmitted at a predetermined second clock rate. In one embodiment, the second clock 
rate is different from the first clock rate (i.e., different pixel and line rates). For example, 
the second clock rate may be faster than the first clock rate, although other 
embodiments are contemplated. The first clock rate must be determined to regenerate 
the audio from the composite stream. 

[25] Fig. 1 illustrates one method, generally designated 10, for regenerating a clock 
rate of an embedded signal transmitting audio data inserted into unused portions of the 
video steam. Audio data at a first clock rated is split and inserted into unused lines 
(blanking portions) of the video stream, forming the composite stream as illustrated by 
block 12. 

[26] The composite stream is transmitted to a receiver at a second clock rate as 
illustrated by block 14. In one embodiment, the second clock rate is different from the 
first clock rate, although other embodiments are contemplated. It should be appreciated 
that the composite stream also includes information on the number of audio samples 
embedded in the composite stream. 

[27] The composite stream is received by the receiver at the second clock rate as 
illustrated by block 16. The original clock rate must be regenerated from the composite 
stream. The average number of audio pixels per line is determined as illustrated by 
block 18 and as discussed below with respect to Figs. 7A and 7B. The first clock rate is 



then determined as illustrated by block 20 using the total line width and nunnber of audio 
pixels per line as discussed in greater detail below. 

[28] A block diagram of a system 22 in accordance with one embodiment of the 
present invention is illustrated in Fig. 2. Fig. 2 Illustrates a high speed serial link 
operating in accordance with a proposed standard, a Digital Video Interface ("DVI") 
version 1.0 standard for an audio extension ("DVI-A") for example. In one embodiment, 
system 22 comprises a multiplexer (MUX) 24, a transmitter (Tx) 26, a receiver (Rx) 28 
and a de-multiplexer (DE-MUX) 30. It should be appreciated that the components are 
illustrated as separate units although other combinations are contemplated. For 
example, the mux 24 and the transmitter 26 could be combined into a single unit and 
receiver 28 and de-mux 30 could be combined into a single unit. 

[29] In one embodiment, the DVI 1 .0 standard makes significant use of existing VESA 
Computer Display standards. The sequence of timing and video data for particular 
display resolutions is specified in the VESA Computer Display Monitor Timing standard, 
Version 1.0, Revision 0.8 dated September 17, 1998, and incorporated herein by 
reference. A recent digital television standard is the CEA-EIA 861 standard for high 
speed digital interfaces, also incorporated herein by reference. 

[30] The DVI Version 1 .0 specification provides for a high-speed digital connection for 
visual data types that are display technology independent. The interface is primarily 
focused at providing a connection between a computer and its display device. 

[31] The DVI link enables content to remain in the lossless digital domain from 
creation to consumption. An exemplary DVI link has three parallel channels for RGB 
video data and one clock channel. DVI-A provides for a straightfonA/ard extension of DVI 
1.0, incorporating additional digital channels over the DVI link. This extension is focused 
primarily on providing a means of transmitting multiple audio streams over the DVI 1 .0 
link. 

[32] System 22 transmits a plurality of data streams D1 ... DN, generally designated 
32, where the number of data streams 32 range anywhere between 2 and 10, 2 and 20, 



20, 2 and 100 or 2 and infinity for example. Prior to multiplexing, each of the data 
streams is originally clocked at clock frequency F1 ... FN, generally designated 34 and 
referred to as the "original clock frequencies", where N ranges anywhere between 2 and 
1,000,000 for example, so that each data stream 32 has a corresponding one clock 
frequency. For example, one of the pluralities of data streams D1 is originally clocked at 
clock frequency Fl prior to multiplexing. It should be appreciated that all the data 
streams may be originally clocked at the same clock frequency, at different clock 
frequencies or that one or more data streams may be clocked at one frequency and 
other data streams clocked at other data frequencies. 

[33] Mux 24 multiplexes the plurality of data streams together prior to transmission by 
the transmitter 26. In one embodiment, composite stream SI , generally designated 36, 
comprises a plurality of data streams, including audio and video data for example, 
multiplexed together using mux 24. The composite stream is discussed in greater detail 
with respect to Fig. 3. 

[34] Fig. 2 illustrates a high speed serial digital data link 38 (i.e., DVI link) between the 
transmitter and receiver. The DVI link enables the transmitter to communicate with the 
receiver as illustrated. For example, the DVI link enables a computer video card to 
communicate with a cable television set-top box or a computer monitor and a television 
or other video display device. It should be appreciated that while the multiplexing and 
de-multiplexing arrangement is discussed with respect to a DVI link, the subject 
invention is applicable to other communication links. The transmitter 26 transmits or 
sends a digital data stream 36 along with a data link clock frequency 40 to the receiver 
28 via the digital data link 32. 

[35] The multiplexed data stream S1 36 is de-multiplexed into the plurality of original 
data streams clocked at their respective original clock frequencies Fl using de-mux 30. 
In one embodiment, the data link clock frequency is higher than the original clock 
frequencies and is not an integer multiple thereof. More specifically, CI is greater than, 
and not an integer multiple of, F1 for example, although other relationships are 
contemplated. The lower clock frequency F1 is not available to the receiver 28, but is 
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regenerated by the receiver 28 in order to provide one or more output signals D1 ... DN 
along with the corresponding one regenerated clock frequencies F1 ... FN. 
[36] One example of a composite stream 36 is Illustrated in Fig. 3. More specifically, 
Fig. 3 illustrates a timing diagram of a horizontal scan line of a DVI system 22 that 
sends audio and video data over the DVI link In accordance with one embodiment of the 
present invention. In the illustrated embodiment, the composite stream S1 comprises a 
plurality of digital data streams of audio and video data multiplexed together. 

[37] In one embodiment, de-mux 30 is used to extract the audio data D1 from the 
composite stream and output the audio data at the original clock frequency. The 
composite stream S1 is, in one example, comprised of a series of data blocks. In one 
embodiment, each data block corresponds to one scan line for a digital video system. 
Each data block is composed of sub-blocks, where D1 Is one of the sub-blocks. 

[38] The sub-blocks correspond to the various different data in one scan line, such as, 
synchronization, audio, video and other data. The D1 sub-block corresponds to the 
audio data sent in each scan line. It should be appreciated that, the number of data 
elements in each of the D1 sub-blocks will vary from block to block, but the aggregate 
data rate of D1 will, in one example, remain constant. AW, generally designated 46, 
represents the width of the audio section of a particular scan line in pixels for example. 
It should be appreciated that this value may vary from line to line. HW, generally 
designated 48, represents the horizontal width of the video scan line in pixels. 

[39] The D1 sub-blocks are extracted from data blocks in the composite stream using 
a timing window or other processing method or device. Fig. 4 illustrates a timing 
diagram of a burst of audio data (D1 ) extracted from a horizontal scan line similar to that 
illustrated in Fig. 3 in accordance with one embodiment of the present invention. The 
stream of extracted D1 sub-blocks is represented as a series of data bursts of variable 
length, as illustrated. Each data block sent by the transmitter 26 includes a data element 
containing the length of the D1 sub-block within that block. This information is provided 
to the receiver 28. 
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[40] Fig. 5 illustrates a block diagram of a FIFO circuit 50 and Phase Locked Loop 
("PLL") 52 used to output the audio data stream at the original clock frequency in 
accordance with one embodiment of the present invention. In one embodiment, the 
FIFO circuit 50 and PLL 52 are incorporated in and part of de-mux 30. However, it 
should be appreciated that FIFO circuit, PLL and the de-mux may be separate units 
coupled together. 

[41] The variable length bursts of digital data D1 at clock rate 01 are transmitted to 
the FIFO circuit 50. The data stream D1 may be returned to Its original timing, by 
clocking it out of the FIFO using clock F1. However, it should be appreciated that clock 
F1 is not available to the receiver 28 and must be regenerated from the information 
available to the receiver. The regenerated clock F1 preferably has low jitter, so as to 
clock D1 out of the FIFO circuit at a constant frequency. 

[42] Fig. 6 illustrates a block diagram of one embodiment of the subsystems of PLL 
52 illustrated in Fig. 5. Preferably PLL 52 is all-digital for example, although other 
embodiments are contemplated. A second order feedback loop 601 determines the 
period, performing the operations illustrated in Figs. 7A and 7B. A half period calculator 
602 performs the operations illustrated in Fig. 8. A numerically controlled oscillator 
("NCO") 603, inverts its output every half period, generating the F1 clock. It should be 
appreciated that the NCO 603 could be made of various circuits well known to those 
skilled in the art. 

[43] One embodiment of the present invention uses an all-digital PLL to generate 
clock F1 from the clock 01. It should be appreciated that in one embodiment clock 01 
has a higher speed than clock F1 for example, although other arrangements are 
contemplated. One process for generating the original or first clock frequencies from the 
higher speed clock 01 is illustrated in Figs. 7A and 7B. An overview of the process is 
illustrated in Fig. 7A, while a more detailed process is illustrated in Fig. 7B. In this 
embodiment, the operations are performed by the second order feedback loop of an all- 
digital PPL, for example. 
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[44] To determine the Period (i.e., generate the original clock frequency), the method 
is initiated and the phase is compared to the horizontal width as illustrated by block 700 
and diamond 702A. The phase and horizontal width are represented as number of 
pixels. If the phase is smaller than HW then the original clock frequency is clocked out 
based on the period as illustrated by block 706. The process continuously compares the 
phase to HW to insure proper sync. 

[451 If the phase is not less than HW, that is the phase is equal to or greater than HW 
as illustrated by diamond 702A, then an audio width for a new line is acquired as 
illustrated by block 705A. Acquiring an audio width for a new line includes updating the 
phase and Period. The updated phase is compared to HW in a continuous fashion, as 
this is a phase locked loop. At some point during this process the period stops 
changing, but the phase is continuously compared to HW to insure proper sync during 
the process. 

[46] The process illustrated in Fig. 7A is shown in greater detail in Fig. 7B. The PLL is 
initiated as illustrated by block 701 (block 700 of Fig. 7A). HW 48 represents the 

3 horizontal width of a video scan line in pixels, where HW is equal to the Period (i.e., the 
i computing period). After convergence (i.e., when the system reaches a steady-state 

4 value), the Period variable is equal to the period of clock F1 , for example, in C1 clock 
i cycles. The Phase variable is the relative position of the PLL within a scan line, for 

example 0.0. The FIFO_clocks variable is used to track the difference between the total 
number of clock pulses F1 generated by the PLL and the total amount of data sent into 
the PLL, here 0.00 for example. 

[47] The Phase is compared to HW as illustrated by diamond 702B. If Phase is less 
than HW, the Phase variable is incremented by the Period and FIFO_clocks is 
incremented by one. For example. If Phase is less than HW, then the new Phase is 
equal to the Phase plus the Period while the FIFO_clocks is equal to the FIFO_clocks 
plus 1 as illustrated by block 703. An F1 clock is generated as illustrated by block 704. 
In one example, the pulse length of F1 is equal to the Period. The process proceeds to 
a set of operations illustrated in Fig. 8, stating at block 801 as discussed in greater 
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detail below. After generating one clock pulse using the operations illustrated in Fig. 8, 
the process returns to block 704 and loops back to block 702 in a continuous manner. It 
should be appreciated that the process described in blocks 703 and 704 are, in one 
example, equal to clocking out the original clock frequency based on the period as 
illustrated by block 706 of Fig. 7A. 

[48] If the Phase is not less than HW as illustrated by diamond 702B, then the PLL 
initiates processing a new scan line as illustrated by block 705B. A new value is 
acquired for AW. The Phase and FIFO_clocks are decremented and a new Phase and 
Period are computed. 

[49] For example, if the Phase is equal to or greater than HW, the new Phase equals 
the Phase minus the value of HW and the FIFO_clocks equals FIFO_clocks minus the 
value of AW. The new phase is equal to Phase + [ALPHA times the FIFO_clocks 
value]. The new Period is equal to the Period + [Beta times the FIFO_clocks value]. It 
should be appreciated that Alpha and Beta are constants for a second order PLL, used 
to set the speed and other operational characteristics of the PLL. The following 
equations for a second order PLL are well known to those skilled in the art: 

[50] Error = True Phase - Phase 

[51] Phase = Phase + [Alpha * Error] + Frequency 

[52] Frequency = Frequency + [Beta * Error] 

[53] Output jitter may be reduced by spreading the phase update across more than 
one audio clock as illustrated by block 705B, instead of doing it all at once. 

[54] The system and method illustrated in Figs. 7A and 7B compute a value for the 
Period of original clock frequencies, in terms of C1 clock pulses. In one example, this 
computation is represented by the following equation: 
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[55] The convergence of the Period of F1 to the original value of the period of F1 
takes place through the incremental computations performed by the operations 
illustrated in Figs. 7A and 7B. 

[56] Fig. 8 illustrates a series of operations performed by a half period calculator. The 
half period calculator generates one full cycle of clock F1 . Block 704 In Fig. 7B outputs a 
value of Period for clock F1 , for example, in terms of the number of pulses of clock C1 
as illustrated by Block 801. 

[57] The Temp variable is set equal to a fractional part of the value of Phase, 
computed in block 703 with a counter variable K set equal to zero for example as 
illustrated by block 802. The value of K is tested as illustrated by diamond 803. If the 
value of K If the value of K is equal to two, then two half cycles of a single clock pulse of 
frequency F1 have been outputted by the NCO 603 illustrated in Fig. 6. Flow then 
returns to the process described by block 704 in Fig. 7B. 

[58] If the value of K is not equal to two, then a value of Half_Period is computed 
using a series of steps as illustrated by block 805. The value of Half_Period is equal to 
one half of the period of clock F1 . The loop consisting of diamond 803 and block 805 is 
performed twice, thus generating two half periods of clock F1 , (one full pulse), by the 
NCO 603. The NCO generates one cycle of clock F1 of length equal to the Period 
variable, where the Period is equal to a number of C1 clock pulses, used as a timing 
reference. 

[59] Fig. 9 is a timing diagram illustrating one example of a possible timing 
relationship between a data link clock C1 and a regenerated audio clock F1. As an 
example, the present invention can compute a value for the period of F1 equal to 7 
clock pulses of C1 . Since the period of F1 as computed, is an odd number, the digital 
PLL, for example, can output one cycle of clock F1 with a first half period of length equal 
to three C1 clock pulses and a second half period of length equal to four C1 clock 
pulses as a rough approximation of the period of F1 . Fig. 9 illustrates such an F1 pulse 
of total length 7, consisting of two-half periods, of three and four 01 clock pulses long. If 
needed, other clock frequencies can be generated in a similar manner. 
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[60] The jitter in such a pulse is high and is provided to illustrate one example of an 
operation of the invention. If realistic clock speeds are used for such a calculation, 165 
MHz for a C1 clock and 96 KHz for a F1 clock for example, then the period of F1 is 
equal to 1718.75 pulses of CI for example. The present invention would then output a 
series of half pulses of length either 1718 or 1719 in a pattern of four pulses, with three 
of length 1719 and one length 1718. Such a pattern would be sufficient to generate an 
F1 clock of 96 KHz with low jitter. 

[61] In an alternate embodiment, the output F1 of the digital PLL of may be sent to an 
analog PLL, prior to sending it to the FIFO, in order to reduce the jitter of the 
regenerated clock F1. 

[62] In another alternate embodiment, two digital PLLs in series may be used in place 
of PLL 52. The first PLL provides a rough approximation of the period of the clock F1 
and the second PLL provides a more accurate approximation of the period of the clock 
F1. 

[63] In yet another alternate embodiment, three PLLs in series may be used in place 
of PLL 52. The first PLL is a digital PLL, which provides a rough approximation of the 
period of the clock of F1. The first digital PLL is followed by a second digital PLL, which 
provides a more accurate approximation of the period of the clock of F1. The second 
PLL is followed by a third PLL, which is an analog PLL, which can further reduce the 
jitter of the regenerated F1 clock. 

[64] Many modifications and variations of the present invention are possible in light of 
the above teachings. Thus, it is to be understood that, within the scope of the appended 
claims, the invention may be practiced othenA/ise than as described hereinabove. 



